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PAVEL CHIGANSKY 

Abstract. Ergodic properties of the signal-filtering pair are studied for continuous time 
finite Markov chains, observed in white noise. The obtained law of large numbers is 
applied to the stability problem of the nonlinear filter with respect to initial conditions. 
The Furstenberg-Khasminskii formula is derived for the top Lyapunov exponent of the 
Zakai equation and is used to estimate the stability index of the filter. 



1. Introduction 

Consider a pair of continuous time random processes {X,Y) = {Xt,Yt)t>o, where the 
signal component X is a Markov chain, taking values in a finite alphabet S = {oi, ...,ad}, 
with transition intensities matrix A and initial distribution i'. The observation process Y 
is given by 

Yt= [ h{Xs)ds + aBt, t>0 (1.1) 
Jo 

with an § i-H^ M function h, constant o" > and a Brownian motion B = {Bt)t>o, independent 
of X. 

The filtering problem is to calculate the conditional probabilities '/rt(i) = P{Xt = ai\^Y)^ 
i = l,...,d where = a{Ys,s < t}, which are the main building blocks of the optimal 
MSE and MAP signal estimates 

d 

X^^^ = ''^^aiirt{i) and A"™^^ = argmax7rt(i) 

.1—1 o-iGS 

given the trajectory of Y up to time t. 

The vector vrj satisfies the Ito stochastic differential equation (SDE) (\21\. see also |17j l 

dirt = A*Trtdt + cj~^ (diag(7rt) - TTtTTl)h[dYt - TTt{h)dt), ttq = i^, (1.2) 

where h stands for the column vector with entries hi := h{ai), i = l,...,d. Hereafter the 
following notations are used: diag(a;), x G M'^ stands for a scalar matrix with entries Xi 
and X* is transposed of x. The space of probability measures on S is identified with the 
simplex S'^-^ = {x e M.'^ : Xi > 0, Yfi=i x^ = 1} and := ^ti for / : S ^ M 

and /i € S'^~^ . For vectors and matrices | • | denotes the £i-norm, i.e. |x| = \xij\. 
Finally := a{Xr,s < r < t}, := a{Yr -Y,,s<r <t} and ^s,t := ^It V ^^^t 
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(^Z*" := ^ot) 6tc. are written for brevity). As usually all the statements involving random 
objects are understood to hold P-a.s. 

The process Bt := {dYs — 'Ks{h)ds) is the innovation Brownian motion with respect 

to the filtration ^^^d so the solution of (|1.2() is a Markov process. In this paper we 
deal with the ergodic properties of the process vr = {'r^t)t>o (and more generally of the pair 
(X, vr)). It should be noted that the Wonham SDE H1.2|) does not fit the standard ergodic 
theory of diffusions (see e.g. ^21)) which usually requires either uniform non-degeneracy 
of the diffusion matrix or Hormander's hypoellipticity conditions. The study of ergodic 
properties of the filtering process for general Markov signals was initiated in early 70's by 
H.Kunita in but one of the main arguments in his results appears to have a serious 
gap, leaving the problem open (see |H] for further details). 

Our main motivation for studying the ergodic properties of the filtering process vr, is the 
stability of the filtering equation ()1.2() with respect to the initial condition. It is not hard 
to see (e.g. as in ^Hl) that (|1.2|) has a unique strong solution, if started from any v € S'^~^ , 
possibly different from v. Denote the corresponding solution by vf = {Ttt)t>o- The filter is 
said to be asymptotically stable, if 

lim IvTt — vfti = 0. (1-3) 

The problem of stability is to find the conditions in terms of A, /i, a and {v,v), which 
guarantee 

There has been much progress in solving the stability problem during the past decade 
for various filtering models: we mention 151 HI IT^ IIUI 1^ for a few. In particular, (|1.3|) for 
the Wonham SDE has been verified recently in |^: it turns out that a stronger exponential 
convergence 

7 := lim - log IvTt - 7ft| < 0, (1.4) 

t^oo t 

holds for any /i, cr > and if the chain X is ergodic, i.e. the limit probabilities 

/ij := limt^oo P(A't = Oj), i = 1, d exist, are positive and independent of v. The stability 
index 7 is of significant practical value, as it quantifies the rate of convergence in (|1.H)) . 
Regretfully it is quite elusive for explicit calculation (see Section El for a summary of the 
available bounds for 7). 

The main result of this paper is the following ergodic theorem for the signal-filtering pair 
(X,7r) 

Theorem 1.1. Assume that X is ergodic, then the Markov-Feller process (A', vr) has a 
unique invariant measure M., such that for any continuous g 



lim - / g{Xs,TTs)ds = [ g{x,u)M-{dx,du) 



„ d 

/ Uig{ai,u)MTr{du) = lim Eg{Xt,TTt), (1.5) 



where A^tt is the ir-marginal of A4. 



The ergodic properties H1.5() are derived from the stability ()1.3() and turn to be useful in 
the study of exponential convergence in (|1.4)1 within the framework due to H.Furstenberg 
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and R.Khasminskii (see ^21; H)- Besides providing an additional insight into the problem, 
the method simplifies derivation of several already known upper bounds for 7 ([2], 0). Also 
it allows to obtain a closed form formula and some higher order asymptotic expansions for 
7 in the two-dimensional case d = 2. 

The proof of Theorem 11.11 is given in the next Section [21 In Section |21 the Law of 
Large Numbers (LLN) from (|1.5j) is applied to the problem of stability, using the Lyapunov 
exponents technique introduced in |2j. 

2. The proof of Theorem II. II 

Since X is a Markov process and vr is the unique strong solution of the time homogeneous 
diffusion SDE (|1.2|) . driven by X and an independent Brownian motion B, the pair (X, vr) 
is Markov. The Feller property for vr, verified in Theorem 2.3, ^ni? is inherited by the pair 
(X, vr). Being a Feller-Markov process on a compact state space, the transition probability 
of {X,tt) has at least one invariant measure (see e.g. proof of Theorem 3.1, jlSj). 

It will be convenient to consider the semiflow generated by ()1.2|) . i.e. the family of 
random maps u 1— > TTg^tiu), t > s > of S'^~^ into itself, obtained by solving (|1.2j) on [s,t] 
subject to vr^ = u. In fact it can be seen, that P-a.s. u 1— > TTs^tiu) is a smooth injective 
S'^~^ —5- S'^^^ map, satisfying Trr^t{'^s,r{u)) = 7rs,t{u), t > r > s > (see e.g. d]). For 
example the process vf^, defined in the Introduction, is nothing but 7ro,f(^') and we will use 
both notations when no confusion occurs. 

The following result is a straightforward modification of Theorem 4.1 in [H], whose proof 
is omitted 

Theorem 2.1. Assume that X is ergodic, then for any v G S'^~^ , s > and ^ g-measurahle 
random vectors u, v € S'^~^ 

lim ];log\7rs,t{u) - 7Ts,t{v)\ < 0. (2.1) 

t-*(Xl t 

The uniqueness of the invariant measure for {X,tt) is established in Theorem 7.1, [S] 
under assumption 1)2.1(1 . 

We will use the following construction for the Markov chain X. Let rj = {r]t)t>o be the 
solution of the Ito equation 

Vt = Vo+ [ dN:ris-, (2.2) 
Jo 

where Ng is a matrix, whose off-diagonal elements are independent Poisson processes with 
intensities Xij and Nf = — ^j^i . If ryo is a random vector, taking values in the standard 
basis E := {ei, e^} of M*^, with P(r/o = e^) = Vi and independent of N ^ then rjt ^ £ for all 
t > and the random process Xt = cuVti'i) is a Markov chain^with transition rates 

matrix A and initial distribution u. 

Let (XqjTTq) be a random variable with distribution A4. Let X be the stationary Markov 
chain, e.g. generated by ()2.2j) . and Y be defined by (|l.lj) with X replaced with X. Finally 
let vf be the solution of ((1.2|) . driven by Y and started from vfo. Evidently the process 
{X, vf) is stationary. It is well known that the set of invariant measures of a stationary 



without loss of generality 7^ a^, i 7^ j can be assumed 
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Feller-Markov process is closed and convex and that the extremal measures are ergodic (see 
e.g. Section 6.3 [201 )• This means that if an invariant measure is unique, it is necessarily 
ergodic and hence the first equality in (|1.5() holds for (X,7r) by the Birkhoff-Kintchine 
LLN for any A^-integrable function g. The second equality follows from the property of 
conditional expectations: 

d 

1=1 

d d 
1=1 i=l 

To verify (|1.5jl for (X, vr), we will use the following coupling 

Lemma 2.2. Assume that A corresponds to an ergodic chain and define (with the usual 
convention inf{0} = oo) 

T = inf{t >Q:Xt = Xt], 

where Xt and Xt are Markov chains corresponding to the solutions of p.2|) . started from 
independent r]o and fjo, independent of N . Then lim„^oo l{T>n} = 0- 

Proof. Consider the embedded discrete time Markov chain '■= X^, n G Z+ with the 
transition probabilities matrix G := exp(A) and initial distribution v. Since X is ergodic, 
all the entries of G are positive (see e.g. JHl)- Similarly Zn := Xn, n G Z4. is a Markov 
chain with the same transition matrix G and initial distribution /i. Moreover the pair 
{Zn, Zn) is a Markov chain as well. Hence, on the set {Zn-i 7^ Zn-i} 

d 

P{Zn + ^n|^„^-i V ^£1) < 1 - J^minGfeiGfi =: r < 1, 

i=i 

and 

P(r > n) =?{Xt / Xt,Vt < n) < P(Zfc + Z^,^k <n) = 

k=0 
n-2 

n l{Z,^Z,}P(^n-l ^ Zn-l\^L2 V ^1^2) < - < Cr", 
fc=0 

with a positive constant C . The required claim holds by the Borel-Cantelli Lemma. □ □ 

Suppose that X and X are as defined in Lemma 12.21 and vr and vr be the corresponding 
filtering processes, generated by (|1.2j) . driven by Y and Y respectively. Note that on the 
set {r < n} the increments of Y and Y coincide after time ra, i.e. Yt — Yn = Yt — Yn, for 
t > n and hence on this set 

7ft = TTn,t{T^O,n{Ti'o)) = TTn,* (vfo,n(7fo)) ■ 
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Then by (EHJ 

- TTtl = |vro,t(zy) - vro,t(7ro)| = 

ko,t('^) - 7ro,((7ro)|l{^>„} + |vr„„((7ro,„(i^)) - 7r„,((7ro,„(7fo)) |l{^<„,} < 

(^o)) I 21{^>„} 

for any fixed n > 0. By Lemma 12.21 and arbitrariness of n, we have^ 

lim liTt - 7ft I = 0. (2.3) 

Now the first equahty in (|1.5|) follows from Lemma 12.21 and (|2.3j) . the LLN for (X,7f) and 
the fact, that P-a.s. convergence implies P-a.s. Cesaro convergence. The last equality in 
(|1.5j) is obtained by means of triangle inequality and dominated convergence. □ 

3. Application to filter stability 

3.1. A brief survey. As was already mentioned in the Introduction, the stability of (|1.2j) 
for ergodic chains is always exponential in the sense that the limit in ()1.4() exists and is 
strictly negative. The existence of the limit 7 follows from the Oseledec Multiplicative 
Ergodic Theorem (MET) and, moreover, it may take no more than a finite number of 
values, depending^ on {u, i>) (see j2] for details). Unfortunately it is extremely hard to come 
up with the exact expression for 7 and usually one gets only qualitative information on its 
dependence on the model parameters. 

The first result of this type was obtained in [0], where the following local low signal-to- 
noise asymptotic has been derived 

lim lim ]■ log ( lim ^) < 7max(A), (3.1) 

(T^OO »00 t \ V^V \l/ — ll\ / 

where 7max(A) is the spectral gap of A, i.e. the largest non-zero real part of the eigenvalues 
of A. Roughly speaking (|3.H) means that in the low signal-to-noise regime the filter is at 
least as stable as the chain itself, if i> and are close enough. 
The following estimates of 7 have been derived in |2] 

7 < — 2 min Kj^ji (3-2) 

^ d ^ 

lim o-'^-i{a) < - 77 V /^j min {hj - h^) (3.3) 



lim a'^^ia) > ^ ^^J' E (^J " ^O'' (3-4) 

where 7(0") is written to emphasize the dependence on the noise intensity a and /i is the 
unique invariant measure of X. Note that the bound (|3.2j) is independent of the observation 



•^Note that unlike in H2.3|l . the filtering processes in Ijl.^^ are generated by H1.2|l . driven by the same 
observations. 

■^as will be clarified below, 7 turns to be independent of {u, u) for d — 2; the actual dependence of 7 on 
(v, v) in the case d > 2 remains unclear. 
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parameters h and a, which suggests that to a certain extent stabihty is inherited by the 
filter from the signal itself. Namely the right hand side of (|3.2|) remains negative if all 
the transition intensities of X are strictly positive. Clearly this condition is much stronger 
than ergodicity. In contrast to (|3.2|) the bounds and (|3.4j) reveal the dependence of 
7 on the noise intensity in the high signal-to-noise regime: the stability index decreases 
quadratically with a if the image of § under h has at least one unique point. This perfectly 
agrees with the fact that otherwise 7(0") may converge to zero as o" — > as mentioned in 

i- 

Recently a non asymptotic version of (|3.2|) was derived in [2] 

l^i"* — TT* I < C* exp ( — 2t min ) j (3-5) 

where C > depends only on {y^v) and, moreover, 

d 

7 < -V'^jminAjj. 

Unlike ()3.2[) or ()3.5() . this bound remains nontrivial as long as the signal is ergodic and A 
has at least one row with all non-zero entries. 

3.2. The method of Lyapunov exponents P]. hi this section we sketch the main idea 
of the approach to filter stability due to R.Atar and O.Zeitouni Recall that the solutions 
of SDE (|1.2jl TTf and vf^ can be obtained by solving the linear Zakai SDE 

dpt = k*ptdt + a-'^d:mg{K)ptdYu (3.6) 

and normalizing vrt = Ptl\pt\ and vff = ptl\pt\^ where pt and pt denote the solutions of (|3.6() 
subject to po = and po = u respectively. 

For a pair of vectors x,y £ M*^, let x A y denote the exterior product, which can be 
identified with the matrix {xii/j — xjyi), i < i,j < d. Then the following elementary 
inequalities hold 

1 A^tl _ \pt/\pt\ 

< Ft - TTtl < 



2 \pt\\pt\ \Pt\\pt\ 

which agrees with the fact that the distance between vectors in S'^^^ can be measured by 
the angle they form. These inequalities suggest that 

lim Y log \TTt -Ttt\= hm ]■ log \pt A pt \ - lim \ log \pt \ - lim 7 log \pt\ (3.7) 

t— »oo t »oo t ♦00 t »oo t 

if the limits in the right hand side exist. Verifying the assumptions of MET (see e.g. ^), 
it was shown in |2| that for any and P the limits exist 

Ai =: lim jlogl/Ojl = lim ]-log\pt\, (3.8) 

t— ►oo t t— »oo t 

are non-random, do not depend on (z^, P) and equal to the top Lyapunov exponent of the 
equation (|3.6() . Notably any solution of ()3.6|) started from a vector from 5"^"^ "picks up" the 
top Lyapunov exponent. This is a consequence of the Perron- Probenious theorem applied 
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in |2j to the positive stochastic flow generated by The matrix pt A pt satisfies a linear 

SDE (see (|3.23j) below) as well and thus is in the scope of MET: 

lim ^log Ipt A pt| < Ai + A2, (3.9) 

where A2 is the second Lyapunov exponent of (|3.6|) . Roughly speaking (|3.9|) means that the 
area between the two solutions of (|3.6jl grows exponentially with a rate not exceeding the 
sum of two Lyapunov exponents, just as in the case of deterministic linear equations with 
constant coefficients. Unlike in (|3.8)) . only inequality can be claimed in (|3.9|) since the flow 
Pt A Pt in not positive anymore and different initial conditions may in principle correspond 
to different Lyapunov exponents. 

Assembhng (|^ . and together it is concluded in ^ that the stability of (fO|) 
is controlled by the Lyapunov spectral gap of (|3.6j) : 

lim -loglvTt -7ft| < A2 - Ai < 0. (3.10) 
t 

Though conceptually appealing, the latter does not immediately provide an easy way to 
verify the desired stability, since Ai and Ai + A2 are usually not easy to calculate. 

Nevertheless the Lyapunov exponents turn to be amenable to asymptotic expansions in 
terms of parameter a: the bound (|3.3() is a combination of the estimates 

]imyX,{a) = lp{h') (3.11) 

and 

^y[\^(cj) + A2(fT)) < \p{h') + /i(/l/lnbr) " ^/"(/^nbr), (3-12) 

where /inbr(ai) := /i(nbr(aj)) with nbr(aj) = argmin„._^„. |/i(aj) — h(aj)\. Both (|3.11jl and 
(|3.12|) are obtained in [2] using the Feynman-Kac type formulae adapted to the filtering 
context. 

3.3. Theorem II. II and Furstenberg-Khasminskii formulae. The objective of this sec- 
tion is to show how the Lyapunov exponents of (|3.6p can be estimated by means of so called 
Furstenberg-Khasminskii formulae. 

Proposition 3.1. Assume that X is ergodic, then 

Ai = / {u{h)fM^{du), (3.13) 

where Ai-j^ is the invariant measure of tt from Theorem M.ll 

Proof. Due to 1)3. 8() . we can work with pt. Since the entries of pt are nonnegative, \pt\ = 
Yli=i Pt{^) ^'^'i by the Ito formula 

dt i 



2 

dt. 



\Pt\ 2 Pt 



d^oz\pt\ = -^^^dptii) - ^{"^hiptii)^^ 

(7"^ ^ hiTTt{i)dYt - -CT"^ ( ^ hiTTt{i) 



i=l 1=1 
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where the property Yl'j=i ^ij — '^^^ used in f . The idea of studying growth rate of the 
solutions of hnear SDEs by projecting them onto the unit sphere {S'^~^ in this case) and 
averaging with respect to the invariant measure of the ^^angle" process ttj, dates back to the 
works of H.Furstenberg and R. Khasminskii (see ^21) and today constitutes an important 
part of the theory of random dynamical systems (see e.g. PP). 

Since vTf (/i) is bounded, lim(_>oo j Jq '^s{h)dBs = (see e.g. Lemma 7.1, Chapter VI [T^l. 
and the required 1)3. 13|) holds by Theorem ll.il 

Ai = lim ];\og\pt\ = lim Y / ((7~'^TTs{h)dYs - ^-a"'^ (7rs{h))'^ds^ 

t^OO t t~*00 t Jq \ I J 

hm - l\-^U,(K)h(X,) - \{j,,{K)f\ds = ^(7-2 / [u{h)fM^{du). 
t^co t Jq \ 2^ ' ) 2 y^d-i 

□ □ 

Remark 3.2. Note that (|3.11|) easily follows from 1)3. 13() . since (the superscript a is used to 
emphasize the dependence on a) 

E{^nh)Y = Eh\Xt) - E{h{Xt) - ^nh))\ 

and lim^_,o E(/i(Xt) - fr^ih)) = 0, t > 0. In fact provides even more information, 

since A^^, though not computable explicitly in general, enjoys nice concentration properties 
revealed by R. Khasminskii and O.Zeitouni in ^HI and G. Golubev in Consider the slow 
stationary Markov chain with generator eA, and let Yf satisfy (|l.ljl with X replaced 
by X^ and be the vector of corresponding conditional probabilities, i.e. the solution of 
1)1.2(1 with A and Y replaced by eA and Y'^ respectively. Then, assuming that all /ij's are 
different and using Theorem 11.11 and the continuous time analog of Theorem 1 in , one 
obtains the asymptotic e — > 

E{h{x!)-r,ih))' = 

(1 + o(i)).iog.- f: E - ^^)" = 

d d 

(1 + o(l))eloge-i J^2/^i ^ A,^- = (l + o(l))eloge-i Yl 2^il^«l- 

i=l j^i j=l 

By a time scaling or directly from the Kolmogorov-Fokker-Plank equation for the density 
of AIttj the latter implies 

d 

E{h{Xt)-^^t{h)f = (l + o(l))a2loga-2^2^i|Aii|, a ^ 0. 

i=l 



and in turn 

d 



Ai(fT) = a-2i^(/i2)- (1 + 0(1)) log a-2^;Ui|Aii|, CT^O. (3.14) 



2' 

i=l 
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Note that the second term in the expansion of Ai((t) as cr ^ does not depend on h and 
is negative, so that the top Lyapunov exponent is actually "slightly smaller" than its limit 

(nrmi . 

Remark 3.3. If cr —> oo, the invariant measure M'^ concentrates at 5^ and hence by ()3.13() 

Inn a''Xi{a) = Un{h)f. (3.15) 

Indeed the stationary process tt^ satisfies 

jr^ = e^*^TT^ + (j^i f e^*(*-") (diag(7^f ) - it^n^*)hdBt, 
Jo 

where B is the innovation Brownian motion Bt = Jq {dYs — 7rJ(/i)ds). Hence, for any 
fixed t > 0, limo-^oo Trf = *7ro- But since the chain X is ergodic, limj^oo *7fo = fi, and 
hence A^^ converges weakly to /x as cj — > oo. 

In fact 1)3. 15() can be further refined, using the results from 

lim Ai(cj) = l(fi(h)fa~^ + lh*Tha~^ + o((J-^), (3.16) 

(T^OO 2 2 

where T is the unique solution of the algebraic Lyapunov equation 

= AT + TA + (diag(/i) - fifi*)hh* (diag(/i) - ^u/x*) , 

in the class of nonnegative definite matrices with j Tij = 0. 

In the two dimensional case d = 2, the exact expression is known for Ai,^ and one gets 
a precise formula for the filter stability index 

Corollary 3.4. For d = 2 and Ah ■= hi - h2 



(A/i)^ / 1 Jq q{x)x{l — x)d2 
~^y~2^ q(x)dx 



7 = -(Ai2 + A21) + ^=^[ - ^ + :ni:iizpi__z^\ (3.17) 



where 
q{x) 



a;2(l — x] 



2 



In particular, 



and 



, 2a^A2i , 2a2(Ai2-A2i) f, x 1 



j{a) = -y'{Ahf + {l + o{l))loga~'^^^, a\0 (3.19) 

2 Ai2 + A21 



7(a) = -(A12 + A21) +a ^(^-^{hj + hl) + (/i2/ii +m/i2)(/Ui/ii +^2/12)) + 

4 (/ll--/l2)Vl/^ „/^-4n ^ /. _ /Q on\ 

^ ^77^^ — IX N + "(^ )' (3-20) 
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Proof. For d = 2 the process pt A pt is one dimensional (cf. (|H.2H|) below) and Zt := 
pt{l)pt{2) - pt{2)pt{l) satisfies 

dZt = -(Ai2 + X2i)Ztdt + a~^{hi + h2)ZtdYt + a~^hih2Ztdt. 

If e.g. Zq > 0, then Zt > for all t > and by the Ito formula 

Ai + A2 =y log = i f j^dZs - l^-^hi + /12)' = 

* t Jo \^s\ ^ 

- (A12 + A21) + + h2) h{Xs)ds + ^) + 

—2 7 7 -'^ —2 / 1 7 \2 i— ►oo 

cj hih2 - -a [hi + h2) > 

-2//1, , u \ 1 1.2 1 7,2 



- (A12 + A21) + (T ^\{hi+ h2)fi{h) - -hi - -hl^ 

Note that in the two dimensional case the upper bound in 1)3. 1U() is always attained. The 
equation (|1.2|1 is also one dimensional and -Kt ■= 7rt(l) satisfies 

dTTt = (A21 - (A12 + X2i)irt)dt + (7~Vt(l - TTt){hi - h2)dBt, 

where B is the innovation Brownian motion. The stationary probability distribution of nt 
has a density q{x), solving the Kolmogorov-Fokker-Plank equation 



dx 



1 (A/i) 52 |- 
(A21 - (A12 + \2i)x)q[x)\ + "-^J \x^{l - xfq{x) 



which has an explicit solution given by (|3.18jl . The formula (|3.17() is nothing but (|3.7|) . 
combined with the above expression for Ai + A2 and the formula (|3.13|) . where the explicit 
integration versus q{x) appears. The asymptotic l|3.19() is obtained by means of the expan- 
sion (|3.14|) . The asymptotic (|3.15|) and the expression for Ai + A2 give the first two terms 
in (pr^ . The last term is obtained via (jSUHl)- □ □ 

In fact both low and high signal-to-noise bounds (|3.H) and l|3.3j) can be obtained by 
means of the same approach. 

Corollary 3.5. Assume that X is ergodic, then for any [v, u) the following global version 
of (jSIII) holds: 

^ l{<y) < 7max(A). (3.21) 
Proof In view of (jSIZI) and (jSHSl), the claim (nrTTjl holds if 

ISI lim I log A p^j < 7max(A), (3.22) 

The process = p" f\Pt satisfies the linear equation 

dZ^ = (A* + A) dt + {HZ^ + Z^ H) dYt + a'^HZ^Hdi, (3.23) 

subject to Zq = u Av', where H := diag(/i). 

Let U'^{s,t) be the fundamental solution of (|3.23j) . i.e. the linear (random) operator 
such that Z^ = U'^{s,t) o ZJ, Vt > s > 0. Denote by Q'' and Q'^ the probability measures, 
induced by (X, Y) when Xq ~ and Xq ~ p respectively. Since p has strictly positive 
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atoms, u <^ ^ and by the Markov property of the pair {X, Y) we have Q'^ ^ Q^. Then any 
event, which occurs Q^-a.s. occurs Q'^-a.s. as well. In particular it is sufficient to prove 
l|3.22|) for the stationary X (note that pt and pt are still the solutions of (|3.6j) subject to v 
and i>). 



The idea of the proof is to "sample" the convergence in (|3.22|) on the subsequence 
0, r, 2r, ... with a fixed r > 0, to apply the LLN and to study the obtained limit via 
limT-^oo liniff— >cx3 • Define li" = Z" /\Z^ \ and let T) be the set of all antisymmetric matrices 
equal to r}/\'q' for some 77, 77' € S'^~^ up to multiplication by a nonzero constant. Clearly V is 
a closed set and the solution of 1)3. 23() evolves in V. MET guarantees that limt^oo \ log \ Z"\ 
exists P-a.s. (see Pj) and thus for an arbitrary constant r > 

lim J log I I = lim ^-log|Z^fc| = 

t— >oo t fc^oo K T 

k 

lim tT^ zlog|C/"(T(m-l),rm)on^ _iJ < 



771=1 

lim — > —log max \U^ (Tim — l),Tm) o v\ 

k^ook^T \v\=l,vGV^ J \ 

771=1 



(3.24) 



— Elog max \U"{{),t)ov\ 

T \v\=l,veD 

The latter equality is due to the LLN, which holds since the summands form a stationary 
uniformly integrable ergodic sequence. Indeed 

Urn := log max u7'^(r(m — 1), rm) o 

\v\=l,v&V 

are measurable with respect to ^ ■^{^ri-i)T mr ^° stationarity and ergodicity 

are inherited from X, the increments of B and their independence. Integrability follows 
from the Gaussian properties of B and is verified similarly to Theorem 1.5 in j^- 
Observe that the solution of ()3.23|) converges uniformly on [0, r] to the solution of 

Qt = A-*Qt + Qt^, Q^ = vyv (3.25) 

as c7 — > 00, i.e. limg— >oo sup(g[o,T] \ '^t ~ Qt\ — 0- Consequently 

U''{^,t)ov ^^^V(S),t)ov, VvGP (3.26) 

where y(s, t) is the fundamental solution of (|3.25j) . Notice that 1/(0, t)ov = Ptf\(lt, where pt 
and qt solve xt = A*xt subject to p, g S S'^~'^ {v = pAq). If X is ergodic, the zero eigenvalue 
of its transition rates matrix is simple and A is a stability matrix on {x G M'^ : Yli=i — 0} 
(see e.g. [IH]): 

\Pt - qt\ = \e^''\p -q)\< cexp (7max(A)t), 
for a constant c > 0. Since ^\pt /\ Qt] < \pt — Qt\ < \Pt /\ qt\, this implies 

lii^^ ilog|y(0,r)o^;| <7^^,(A), ^veV. (3.27) 

T— >oo T 
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Passing to the limits limT-_>oo linio-^oo in (!^'i-24|) and taking into account (|^-i.26j) and (lll'iTj) . 
one gets the required 

Wi lim ylogjZfl <7max(A). □ 

cr— ►oo i— >oo t 

□ 

Corollary 3.6. Assume that X is ergodic, then (|3.3j) holds. 
Proof. In view of Remark 13.21 (|3.3() holds if 

1 

limcj2(Ai(cj) + A2(a)) < ^l{h'^) - -Y^ fii min {h{ai) - h{aj)f . (3.28) 

1=1 

Let cr := and •= Pta^ be the time scaled solutions of 1)3. 6|) subject to v and 
respectively. Then 

hm J log |pf A I = ^ lim 1 log [Cf A Cfl, 

where the limits exist by the Oseledec MET as mentioned before. The process (and Ct) 
satisfies the equation 

dCf = a^A*Ctdt + HQdWt, 

where Wt = /q h{Xg^2)ds + Bt and Bt := a~^B^^2 is a standard Brownian motion. Conse- 
quently the process = Ct ^ Ct satisfies the linear equation 

dR^ = a'^{h*Rl + RlA)dt + [HR1 + R^H)dWt + HR'^Hdt, 

subject to Rq = V In the componentwise notation the latter reads 

dRl^{t) = a\Y.^,^^U^) + E ^jkRUit))dt+ 

{h^ + hi,)RUt)dWt + h^hkRl„,{t)dt, k^m. (3.29) 

Let U°'{s,t) denote the fundamental solution of H3.29|) (cf. 1)3. 23() '). i.e. a tensor whose 
entries U^ - j.^{s,t) are ^jj-measurable and 

Rl^{t)=\u"{s,t)oR'A =Y^U^^k^{s,t)R1^{s), k^m. (3.30) 
For fixed i ^ j, U[j kmi^-i entries of the matrix generated by (|3.29j) . subject to 



1, i = k, j = m 
0, otherwise. 



Define 

lpl„^{s,t) := exp ((T^(Afcfc + Xmrn){t - s) + 



{hk + h^){Wt - Ws) + hkh^{t - s) - ^(/ifc + hmf{t - s)). 
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Then for i 7^ j and k ^ m 



ft 



,qmi'^T'^)]d'U. (3.31) 



Since the ofF-diagonal entries of A are nonnegative, the latter imphes that V{s,t) is a 
positive operator. Let V[-^^^{s,t) = t^^- *)/ Efc^m then 

K^m - k^m i^k e^m 

{hm + hk)V^^k^{s, r)dWr + J Yl f^rn^kV^j,km{s, r)dr- 



1 /■* 
2 



k^m 



J S I / 

where Amax = maxj^j Ajj and /imax = niaxj | /ij | . The latter and (|3.31|) gives the following 
estimate 

U[,,kn.{s, t) < rkmis. t)S^r + a^Cie^^^*-^) exp (^J^ ,^(r)d5,,) du 
with some constants Ci and C2 and bounded processes Pfj (t) . Moreover 

:= Cie^^(*-^) ^*exp (^"^ ,^(r)d5,) d^z 

are uniformly integrable in a, since bounded i^,^{f') trivially satisfy the Novikov condition 
Eexp (^i < 00 (see Theorem 6.1 in [T7|). Define W{t) = {t) / \R'' {t)\ 

and fix a T > 0, then for t > r (see p.30p ) 

log \R'^{t)\ = log \R'^{t - r)| + log I ^ C/4,^(t - r, t)nf^.(t - r)| < 

log |i2'^(t - r) I + log max V ^7^. ^^(t - r, t) < 
log |i2'"(t - r)| + log ( max Vr, (i - r, t) + max V ^^(t - r, t) 
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As was mentioned before, it is enough to establish ()3.28|) for the stationary chain X. Recall 
that by MET the limit limj_+oo j log \Rt \ exists P-a.s. Then for any i/, i/ G S'^~^ and r > 

1 1 
lim -logli^t^^l = lim — log|Krl < 

t— >c« t n—ioo TIT 



-E log ( max ipfj (O, r) + fi^ max V fij^kmi^, t 



The latter equality holds by LLN, since being measurable functionals of the increments of 
X and B on the intervals [{£ - l)r, £r), both ipfj {{£ - 1)t, It) and ^ij^kmii^ - 1)"^' ^t") , ^ > 1 
form stationary sequences with finite expectations. On the set := {Xq = X^^2, u < t} 
we have 

i^kmi^, -t) = exp (cT2(Afcfc + \mm)T + (hk + hm)Wr + 

hkhmT - ^(/ifc + h^fr) = 

exp [hkhmT - ^(/ifc + hmfT + (/ifc + hrn)h{XQ)T+ 



exp (/i2(Xo)t - ]^{hk - h{Xo)fT - ^{hrn " h{Xo)fT+ 



{hk + hm)Br + 0-^(Afcfc + Amm)T ) = 
{hm - h{X^)fT+ 
{hk + hm)Br + 0-^(AA:fc + Xm.m)T) < 



exp (/i^(Xo)r - ^ min (/i^ - /i(Xo))^r + 2/imax|-B^| + 2cicr^AmaxT") • 

Since the process is a slow chain with the generator cj^A, limo-^o Ps(^r) ~ ^ ^^^^ 
fixed T > 0. This gives the following estimate 

lim -logli^i^^l < 

t— »oo t 

-El|^<T|(/l^(Xo)r - min - /l(Xo))^r + 2/lmax|-Br| + 2d(T^AmaxT) + 

-El{n\Af } log ( max Vrj(0, r) + ct^ max V 93^,- fcm(0, r)) 

k^m 



E /i^(Xo)-- min (/i^ - /i(Xo))' + 
which implies H3.28() as r ^ cxo. □ □ 

4. Conclusions 

The Wonham and Kalman-Bucy filters are particular instances of the general filtering 
equation, for which finite dimensional realizations are known. Consequently both are of 
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considerable practical interest in various applications (see e.g. [Zj). While the stability 
and ergodic properties for the linear Kalman-Bucy filter has been studied and understood 
since 60's, the analogous theory for the Wonham filter is less developed and in fact was 
addressed only a decade ago. In this paper we established certain ergodic properties of 
the signal/filtering pair, which are crucial for applying the classic Lyapunov exponents 
technique for SDEs (52]) the filtering context. The latter allows to derive refined formulae 
for the Lyapunov exponents of the Zakai equation and simplify derivation of certain known 
bounds on the filter stability index. In particular case of the binary signal, a complete 
characterization of the filter stability is obtained. 

Acknowledgements. I am grateful to Zvi Artstein and Ramon van Handel for their 
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by the comments of anonymous referee. 
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